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SYSTEM AND METHOD FOR PATTERN IDENTIFICATION 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

This invention relates to machine vision, and more particularly, to a system and method 
for pattern identification. 

2. Description of the Related Art 

Automated manufacturing processes often rely on machine vision systems to identity and 
locate parts that are being assembled. This allows a machine, such as a robot, to interact with 
( e.g. , pick up) the individual parts using pattern recognition. For example, the pattern could be 
an image of the part, such as an image of a keypad of a cellular phone unit that is to be assembled 
in a housing. A linear pattern, such as a cross hair, may also be used to aid in precision 
alignment. 

Various methods of machine vision positioning are currently practiced, including 
variations based on the general Hough transform and variations based on correlation (template 
matching). Correlation may use binary exclusive-OR correlation and, more recently, gray-scale 
normalized correlation. One common element of these systems is that they require, as input, an 
image template of the part whose pattern is being located. 

The Hough transform, however, is inefficient when the part to be located is subject to 
rotation because, generally, multiple analyses must be performed using different potential angles 
of rotation. Specifically, for each possible angle of rotation, the Hough transform generally 
requires a separate reference table. Accordingly, if a user wants to have full rotation search 
capability at ten degree increments in angles of rotation, then the Hough transform would require 
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a minimum of thirty-six tables, and then sequential searches would have to be performed on each 
table. Because such a analysis is computationally demanding, the search time is significantly 
increased. 

5 SUMMARY OF THE INVENTION 

Therefore, a need has arisen for a system and method for pattern identification that 
overcomes these and other shortcomings of the related art. 

According to one embodiment of the present invention, a method for locating a pattern is 
disclosed. The method includes the steps of (1) providing a pattern image corresponding to the 
10 O pattern to be located; (2) extracting a pattern contour from the pattern image; (3) generating 
Ef§ vector information for the pattern contours, relative to a reference point; (4) creating a reference 
q table for storing the vector information, the reference tables corresponding to the pattern contour; 
;ip (5) providing a scene image, which will be searched for the pattern; (6) extracting a scene 
^ contour from the scene image; (7) generating vector information for the scene contours; and (8) 
15 !^ determining whether the pattern has been located within the scene image using the reference 
y table and the vector information for the scene contour, and if so, identifying a location of the 
O pattern within the scene image and an angle of rotation of the pattern within the scene image. 

In another embodiment, a method for pattern recognition comprises the following steps: 
(1) extracting pattern vector information from at least one pattern image, each pattern image 
20 having a pattern reference point; (2) creating a reference table containing the pattern vector 
information for each of the at least one pattern image; (3) extracting scene contour information 
from a scene image; (4) calculating a potential reference point based on the scene contour 
information and the reference table; (5) matching the potential reference point with one of the at 
least one pattern reference points; and (6) identifying a pattern image corresponding to the 
25 matching pattern reference point. 

In still another embodiment, a system for pattern identification is disclosed. The system 



includes a first image capture device that captures a pattern image which includes an image of a 
pattern; a second image capture device that captures a scene image to be searched for the pattern; 
a processor processing the images, which includes means for extracting at least one pattern 
contour from the pattern image; means for generating vector information for each of said at least 
one pattern contours, relative to a reference point; means for creating at least one reference table 
for storing vector information, each of said at least one reference tables corresponding to at least 
one pattern contour; a means for extracting at least one scene contour from a scene image; means 
for generating vector information for each of said at least one scene contours; and means for 
locating the pattern image within the scene image using the at least one reference tables and the 
vector information for the at least one scene contours. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, the objects and advantages 
thereof, reference is now made to the following descriptions taken in connection with the 
accompanying drawings in which: 

Fig. 1 depicts an example of a pattern; 

Fig, 2 illustrates an illustration of a contour according to one embodiment of the present 
invention; 

Fig. 3 illustrates a flowchart of a method for pattern identification according to one 
embodiment of the present invention; 

Fig. 4 illustrates a flowchart of a training process; 
Fig. 5 illustrates a flowchart of a search process; 

Fig. 6a illustrates an example of a pattern (x, y) location image according to one 
embodiment of the present invention; 

Fig. 6b illustrates an example of a pattern angle image according to one embodiment of 
the present invention; 



Fig. 7 illustrates an example of a pattern image to be trained; 

Fig. 8 illustrates the pattern image of Fig. 7 including index points, front and back points, 
and stick vectors; 

Fig. 9 illustrates a graphical plot of the points identified in Fig. 8; 

Fig. 10 illustrates scene image to be searched for the pattern shown in Fig. 7; 

Fig. 11 illustrates a plot of the index points and front and back points of the scene image 
of Fig. 10; and 

Fig. 12 illustrates an image of the accumulator for the scene image of Fig. 10. 

DETAILED DESCRIPTION OF THE INVENTION 

The preferred embodiment of the present invention and its advantages are best understood 
by referring to Figs. 1 through 12 of the drawings, like numerals being used for like and 
corresponding parts of the various drawings. 

For convenience, the present invention will be described with the following convention, 
with reference to image 102 shown in Fig. 1. Image 102 may be a digital image of a part or an 
object. In the figure, image 102 is a digital image of a shutter speed selection knob for a camera. 
It may be desirable for a machine to determine the precise orientation of this part (such as its 
rotation) so that a machine may properly interact with this part during assembly. 

Image 102 may include one or more patterns 103. In the figure, image 102 includes 
several patterns 103, including, for example, the outer cylindrical surface of the knob, the hollow 
interior of the knob, as well as the various numbers and letters on the knob indicating different 
shutter speeds. 

Pattern 103 may also include at least one contour 104. In general, contour 104 may be 
thought of as being an ordered list of edge point coordinates that describe a boundary of a 
pattern, including both internal and external boundaries. In the figure, for example, contour 104 
is indicated at the outer edge of the knob. 



Generally, the present invention "trains" on image 102 so that the invention will know the 
pattern of the part for which the invention is looking. During the training process, the present 
invention is given, or creates, a "pattern image/' and the system trains on the pattern image. 
During the searching process, the present invention searches a "scene image" in an effort to 
locate the pattern that was used to train the system. So, when the term "pattern image" is used, 
this application is referring to the image used in training, and when the term "scene image" is 
used, this application is referring to the search process. 

A brief discussion of the theory of the present invention is provided. Fig. 2 illustrates a 
contour that has been extracted, for example, from a pattern image during the training process. 
Referring to Fig. 2, contour 202 includes a plurality of contour points 204, which lie along 
contour 202. Index point 206 (located at (x 0? yo)) ; which is a contour point, is selected, and two 
reference points, back point 208 (located at (xi, y0, and "behind" index point 206 by a constant 
k) and front point 210 (located at (x 2 , yi), and "in front of index point 206 by a constant k (not 
shown)) are selected. Variable k controls the locality of the curvature measurement. In one 
embodiment, k represents the number of contour points that separate back point 208 from index 
point 206, which is the same as the number of contour points separating front point 210 from 
index point 206. A smaller value for k gives very local curvature measurements, while a larger 
value for k gives more global measurements. 

In one embodiment, indices of front point 208 and back point 210 may be selected 
automatically. In general, they are separated from index of index point 206 by k (Le., each is k 
data points away from index point 206). The index of front point 208 is smaller than the index of 
index point 206 by k, while the index of back point 210 is larger than the index of index point 
206 by k. For example, if (x 0 , yo) is at index 100, then back point 208 is the point at index 90, 
and front point 210 is at index 1 10 (for £=10). 

Generally, k is chosen based upon the severity of the curves in the pattern contours and 
based upon the number of contour points that are used to represent the contour. Generally, a 
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smaller k may be preferred, but k must not be too small. A k of 10 will work in most standard 
applications. 

Stick vector 212, which is a vector that connects back point 208 and front point 210, has a 
direction representing the direction of "crawl;" that is, the direction from back point 208 to front 
5 point 210. Stick vector 2 1 2 has an angle of 9 0 relative to the horizontal axis. 

In another embodiment, an additional back point (not shown) and an additional front 
point (not shown) may also be used. In general, these points maybe indexed with a value greater 
than t These points may be used to define an additional stick vector (not shown), which may 
provide additional information regarding contour 202. 
10 ; 5 Line 209 connects index point 206 and back point 208, while line 211 connects index 

ER point 206 and front point 210. Angle 02 represents the angle between stick 212 and line 211. 
G Algorithm reference point 214, located at (x c , yc), may be selected by a user, or it may be 

the centroid of the pattern, as will be discussed in greater detail below, 
s A distance h represents a contour curvature measure for contour point 206. The distance 

15 g h is the shortest distance from index point 206 to stick 212. For example, for an appropriate k 
;3 value, a value of h=0 indicates that the stick is falling on a straight line. 

jyig Vector R may be constructed by drawing a vector from contour point 206 to algorithm 

reference point 214. This vector has magnitude of d, a direction pointing from contour point 206 
to algorithm reference point 214, and angle 0i relative to the horizontal axis. Angle 80 is the 

20 angle between R and stick vector 212. Angle 80 may also be referred to as the "SR Angle." 

Angle 80 is rotation invariant. This means that regardless of any rotation of contour 202 (or 
rotation of the part/object) relative to the horizontal axis, this angle is the same for a particular 
point on contour 202. Because angle 80 is rotation invariant, it is an ideal variable, as it reduces 
search time significantly. It also eliminates the need for a separate table for each angle of 

25 rotation. 

Angle 80 Gr adient is the angle between gradient 216 and vector R. This may also be referred 



to as the "GR Angle." In general, 80Gradient determines the position of algorithm reference point 
214 relative to stick vector 212 (i.e. , (on what side of stick vector 212) so long as contour 202 is 
crawled on in the same direction when training and when searching. Crawling in the same 
direction may not happen in every image, due to disconnection or extra connection of a contour. 

In general, the lengths and angles identified above may be determined by trigonometry, or 
by other higher-level mathematics. 

With the convention and theory described above in mind, a flowchart of a method for 
pattern identification according to one embodiment of the present invention is provided in Fig. 3. 
First, in step 302, the system is "trained" on a pattern image. Referring to Fig. 4, a flowchart of 
the training process is provided. First, in step 402, pattern contours are extracted from the 
pattern image. In one embodiment, this may be achieved by detecting the levels of the edges on 
the pattern image, which computes the optimal value for the edge level (Le., the edge strength) in 
order to filter out noise edge pixels. Other filters may be used as desired. 

Pattern contours may be extracted from the pattern image, preferably after any 
conditioning. In one embodiment, an extraction engine, such as EdgeCrawler, developed by 
Imaging Technology, Inc., of Bedford, Massachusetts, may be used to extract the contours from 
the pattern image. The extraction engine may extract edge pixels by running a Gaussian filter 
followed by a Sobel transform. Non-maxima suppression may be performed on all edge points 
above the value of the level detected by the edge level detection. In another embodiment, a top- 
down crawler may be used to create a contour from the edges. 

In another embodiment, the edges may be extracted by locating at least one edge of the 
pattern image of the scene image and recording a starting point for the edge. The edge is then 
"crawled" along; that is, each pixel along the edge is analyzed. As the pixels are analyzed, they 
may be extracted from the edge, and then may be filtered. A contour may then be created from 
the filtered and extracted pixels. 

Next, in step 404, the extracted contours may be conditioned. This step helps to identify 



and add undetected edge points, if any. In addition, aliased edge points may be removed. In one 
embodiment, each contour may be spatially filtered with a 5 x 1 filter. Of course, different filters 
may be used. Each contour may then be normalized to create a new set of contours in which the 
distance between any neighboring points is 1.0 (one) pixel. Raw contour points may have a 
spacing that varies between 1 and 1.41 pixels in distance, depending on the angle between points. 
The result of the contour conditioning stage is at least one pattern contour. 

In step 406, an algorithm reference (x, y) position may be selected. Step 406 may be 
exercised before step 404, or even after step 408. In one embodiment, the reference point may be 
the centroid coordinate, or central moment, of the pattern contour(s). At the end of searching, the 
algorithm reference point may be translated back to user coordinates. 

In step 408, the pattern contour may be optimized. This may be accomplished by setting 
levels based on the analysis of pattern contours, including the number of contour points, the 
curvature statistics of contour points, etc. These points may be used to determine the values of 
each parameter. 

In step 410, a reference table is created. This may be performed simultaneously with step 
408. This may be accomplished by analyzing every contour in the pattern contours, and for every 
point on the contour, extracting the contour curvature, h, the vector R (r, 0i), the angle between 
the R vector and the stick vector 50, and the angle SOcradient. In one embodiment, these values 
may be grouped in a reference table according to their contour curvature h in order to decrease 
search time, and to better shape the peak shape in the pattern location image, discussed below. 

An example of a reference table is provided below, wherein each rectangle may include 
data represented genetically by variable. The fact that the identical variables are shown in the 
table is not intended to suggest that each measurement for the variables are identical. 
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Referring again to Fig. 3, in step 304, once the training is complete, the reference table 
and related information may be stored in a database. In one embodiment, the database may 
include a plurality of reference tables for different pattern images. 

In step 306, a scene image is acquired. In one embodiment, the scene image may be 
acquired in real-time; in other embodiments, the scene image may be acquired from a database, 
or provided to the system form an outside source. 

In step 308, the scene image is searched. Referring to Fig. 5, a flowchart of the search 
process is provided. In step 502, contours are extracted from the scene image. In one 
embodiment, contours may be extracted from the scene image in the same way that contours 
were extracted from the pattern image. Therefore, a detailed description of this step is omitted. 

In step 504, the contours may be conditioned and/or normalized. In one embodiment, 
contours may be conditioned and/or normalized from the scene image in the same way that 
contours were conditioned and/or normalized from the pattern image. Therefore, a detailed 
description of this step is omitted. 

In step 506, as the contour points are crawled, the values of h, 9q, and Ocradient for each 



- 10- 

contour point are determined. 

In step 508, the location of a potential reference point is computed from scene 9o (the 
angle between a scene stick and the horizontal axis) and R (r, 80 1) of a cell in the table. In doing 
so, the scene contour curvature value, h, may be used to select a column of the table. A potential 
reference point for the scene pattern is calculated for each table cell in that column (all the points 
with the same contour curvature value h). 

The potential reference point (x, y) is entered into a reference point accumulator which 
"counts" each instance of a potential reference point. In one embodiment, a pattern location 
image, in which the pixel value at the reference coordinates is incremented each time a 
calculation yields a reference point with that coordinate, is used as the accumulator. In other 
words, the "height" of a particular coordinate increases each time the particular coordinate is 
calculated as a potential reference point. In one embodiment, this step may be repeated for each 
of the scene contour points. 

An example of a pattern location image is provided in Fig. 6a. In Fig. 6a, the tallest 
column reflects an accumulator that shows the greatest number of "hits," and hence, the greater 
likelihood of a match. 

Referring again to Fig. 5, in step 510, the angle of rotation of the pattern may be 
computed. This angle may be computed based upon the angle difference between Go (stick vector 
angle) of scene point, and 9o in the table cell. This angle is also entered into an angle 
accumulator, which tallies each instance of an angle. In one embodiment, a pattern angle image 
in which the angle value is stored (stacked) at computed (x, y) coordinates may be used. 

In another embodiment, the angle difference between Boradient of the scene point, and 
QGradient in the table cell may be used. In general, however, 9o may be more stable than Ooradient- 

An example of a pattern angle image is provided in Fig. 6b. 

Referring again to Fig. 5, in step 512, after all points are processed, the accumulator for 
the potential reference point is analyzed to determine the best potential reference point. 



Next, in step 514, the angle of rotation is determined. In one embodiment, a clustering 
algorithm, may be used to determine the angle of rotation. The clustering algorithm may return a 
predetermined number of strong "peaks," as well as smaller peaks near a strong peak. The 
clustering algorithm may average the peaks to return the most likely angle of rotation. 

In step 516, edges may be verified. After the best potential reference point and rotation 
angle for the pattern are identified, the position of all edge points for the potential reference point 
(forming a potential pattern) may be translated into the coordinates of the scene. This may be 
done by moving a position of the potential pattern to the potential reference point, and then 
rotating the potential pattern using the angle returned by the search. Depending-on the accuracy, 
the two sets of edge points (edge points for the potential pattern, and edge points for the pattern) 
may overlap spatially. The movement and the rotation should cause the edges of the potential 
pattern and the pattern image to overlap. The verification procedure verifies that, for each model 
edge point, there is a corresponding edge point in the scene. 

Through processing all the points, two numbers can be measured: the number of edge 
points that verified positive (Le., aligned or matched), and number of points that verified negative 
( i.e., did not align or did not match). These numbers may be used to compute a "score," which 
represents a similarity measure between the potential pattern edges and the pattern edges at given 
point and angle. For example: if the number of positive edge points (Np) is 1000, and the 
number of negative edge points (Nn) is 100, the "score" maybe determined as: 

Score = — — — 
Np + Nn 

In the example, the score is .0909, or 90.9%. The score may be used to determine 
whether or not the potential reference point is satisfactory. 

It should be noted that the present invention may be implemented using an image capture 
device, such as a digital camera, as well as a processor. An example of a suitable processor is a 
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Pentium®-series processor, manufactured by Intel, Inc., Santa Clara, California. In another 
embodiment, an application-specific integrated circuit (ASIC) may be used. In still another 
embodiment, a digital signal processor (DSP) may be used. Other processor types may be used 
as desired. 

EXAMPLE 

In order to better understand the present invention, an example is provided. This example 
does not limit the present invention in any way, and is intended to illustrate one embodiment of 
the present invention. 

The example may be understood by referring to Figs. 7-12. Fig. 7 depicts a pattern that is 
to be trained; specifically, this figure includes sample shutter part 702. Referring to Fig. 8, 
shutter 702 has reference point 802, as well as index points 804, 806, 808, 810, 812, and 814. 
Each index point i (x0/, y0,-) has a front point (x2,, y2/) and a back point (xl/, yl;), which are each 
connected by a stick vector. 

If the coordinates for reference point 802 are xc= 284 and yc= 192, then the coordinates 
of the index points z, with their respective back points and front points, are: 

The points back points front points 
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These points are plotted in the graph of Fig. 9, with the index points plotted as "x" and 
the back and front points plotted as "o." 
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Next, the angle of each stick vector with respect to the x-axis, Go, for each point, z, is 
determined. This may be determined by the following equation: 



0 O . = atan 2 [x2 i -xl i ,(y2 i -yl i )-l] 
Thus, for each stick vector, the angle 6 0 is: 



GO 



0.898 

2.944 

-2.435 

-1.423 

-1.154 

0.902 



The vector angle of the R vector, Gi, for each index point i may be determined by the 
following equation: 

0 U = arctanjxO,. - xc,-(yO i - yc)] 
Thus, the resulting angles are: 



81 



-3.048 
-1.755 
-1.155 
-0.15 
0.739 
1.998 



The magnitude of the R vector, r, at point with index i may be determined by the 
following equation: 
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v%/fc- sD i) a+ ( yc ~ y0 i) a 



The angle difference 59 (the SR Angle) for each index point i is then determined by 
subtracting 81 from 0q: 



-3.946 
-4.698 
1.28 
1.273 
1.893 
1.097 

Next, angle 02 for each index point i is determined by the equation: 



e 2i = arctan[x2 ; -xO i ,-(y2 i -j>0,)] 



Next, the contour curvature, h, for each point, i, is determined. 



Where a ; = 0i -9 2 . 
Thus, the values of h are: 



h = 



8.387 
1.061 
5.13 
-0.906 
4.649 
-0.707 



After these computations, the reference table is created. For the example, the reference 
table is: 
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In order to aid in the description of the search process, and to avoid confusion, a subscript 
r will be added to variables h and Go in the search procedure. 

Referring to Fig. 10, a scene image is provided. In the same manner described above, the 
contours are extracted and processed. As an example, several edge points have been selected to 
show computations in detail. For Fig. 10, the coordinates of the index points /, with their 
respective back points and front points, are: 



xD.:= 




xl.:= 

1 


yV= 


x2.:= 

1 


1\- 


454.44 




320.86 




459.39 




306.41 




439.14 




325.28 


404.46 




256.85 




389.00 




251.44 




417.90 




262.40 


365.49 




253.50 




358.95 




264.30 




381.54 




249.97 


353.11 




307.43 




352.36 




318.21 




352.21 




293.48 


321.81 




357.01 




331.54 




370.95 




324.09 




343.99 


390.35 




345.81 




400 95 




338.31 




380.08 




357.62 



These points are plotted in the graph of Fig. 11, with the index points plotted as "x" and 
the back points plotted as "o," 

Next, the angle of each stick vector with respect to the x-axis, Go, the angle 82, and the 
contour curvature hr for each point, z, is determined in the same manner described above. Thus, 
the stick vector angles Go and the contour curvatures hr are: 
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-2.391 8.837 

-0.362 1.061 

0.565 5.13 

5 0 O = 1.577 hr= -0.906 

1.84 4.649 

-2.395 -0.707 



Next, the potential reference point is calculated. First, for points with a contour curvature 
10 above ±7, only one point exists at i = 0. Thus, the potential reference point and angle of rotation 
are calculated for this point: 



81 0 :=80 0 + a o 

xcfouncL :=3d0 - r Q - cos (81 J) 

„ , ^ . V, { xcfound =381.741 
ycfound :=y0 +r sin 81 0 

ycfound = 316.883 



rotAngle o :=eO fo -e0 0 rotAng > 3 . 29 



For points with a contour curvature above about ±5, two points exist at i = 2 and i = 4. 
Thus, the potential reference point and angle of rotation are calculated for these points: 



»V=80 a + » a 



xcfound 2 :=xD 2 - f^cos^l^ 

. \ xcfound^ = 383.297 
ycfound^ :=y0 2 4- r -sinful J 2 

ycfound 2 = 316.629 
rotAngle 2 :=e0r 2 - 80 2 fotAngle _ 3 .001 



81 :=80,+i 



xcfound, = 382.163 

4 



xcfound^ := x0 4 - r 4 * cos |81 ^ 

ycfound 4 :=y0 +r 4 -sin(81 4 ) 

ycfomd 4 = 316.481 

rotAngle, :=80r. -80. . . , n ftn , 

+ 4 4 rotAngLe 4 s -2.994 
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For points with a contour curvature of about ±1, three points exist at i = 1, i = 3, and z = 5. 
Thus, the potential reference point and angle of rotation are calculated for these points: 
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81 x :=e0 1 + 3B 1 



xcfound 1 = 382.408 



ycfoundj = 317.556 
roUWV =80 V 60 l f0 tAngle 1 . 3.306 



81 5 :=90 5 + S9 5 



xcfound^ :=3dD 5 - ar^-cos (j61^ 
ycfound^ :=y0 5 + r^sin^l^ 

rotAngle :=80r - 80 



xcfound^ = 382.199 
ycfound^ = 316.64 
rotAngle 5 = 3.297 



Trl 81 3 : =80 3 + flB 3 

^ xcfound^ :=x0 3 - r 3 * cos ^91^ 

□ y cf bund, : = yO + jl * sin ft) 1 3 } xcf ound 3 3S3 3:57 

O ycfouad^ = 316.469 

!| roiAngle 3 :=60 S - 90 3 = _ 3 

^ After these calculations, the potential reference points (xcfound,-, ycfound z ) are added to 

if 1 ™? 

Q an accumulator. Referring to Fig. 12, an image of the accumulator is provided. For the angles of 
O rotation, the same process is repeated. 

The results of the computation show that the potential reference point is about (383, 317) 
5 and at an angle of about 3.1 radians. These results coincide with the actual reference point 
location, which is (383,318) and an angle of 318.94 - 3.298 radians. 

While the invention has been particularly shown and described by the foregoing detailed 
description, it will be understood by those skilled in the art that various other changes in form 
and detail may be made without departing from the spirit and scope of the invention. 
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WHAT IS CLAIMED IS: 



- 18- 



1 . A method for locating a pattern, comprising: 

providing a pattern image corresponding to the pattern to be located; 
5 extracting at least one pattern contour from the pattern image; 

generating vector information for each of said at least one pattern contours, relative to a 

reference point; 

creating at least one reference table for storing the vector information, each of said at least 
one reference tables corresponding to said at least one pattern contour; 
10 providing a scene image, which will be searched for the pattern; 

extracting at least one scene contour from the scene image; 
~S generating vector information for each of said at least one scene contours; and 

^ determining whether the pattern has been located within the scene image using the at least 

O one reference tables and the vector information for the at least one scene contours, and if so, 
15 ^ identifying a location of the pattern within the scene image and an angle of rotation of the pattern 
^ within the scene image. 

S 2. The method of claim 1, wherein the step of extracting at least one pattern contour from 
^ the pattern image comprises: 
20 □ locating at least one edge in the pattern image; 

recording a starting point for the at least one edge; 
crawling along the at least one edge of the pattern image; 

extracting a plurality of pixels from the at least one edge, beginning with the starting 
point and continuing with pixels identified while crawling along the at least one edge; 



25 filtering the plurality of extracted pixels; and 

creating a pattern contour from the plurality of extracted pixels. 

3. The method of claim 1, wherein the step of extracting at least one pattern contour from a 
pattern image comprises: 
30 extracting at least one pattern contour from the pattern image; 
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identifying undetected edge points; and 

modifying the at least one pattern contour to add any undetected edge points. 

4. The method of claim 3, wherein the step of extracting at least one pattern contour from a 
pattern image further comprises: 

removing aliased edge points from the at least one pattern contour; 
spatially filtering the pattern contours; and 
resampling the filtered pattern contours. 

5. The method of claim 1, wherein the step of generating vector information for each of said 
at least one pattern contours comprises: 

selecting a reference point for each of said at least one pattern contours; and 
generating vector information for each of said at least one pattern contours, relative to the 
selected reference point. 

6. The method of claim 1, wherein the step of generating vector information for each of said 
at least one pattern contours, relative to the selected reference point, comprises: 

choosing an index point corresponding to a point along said at least one pattern contour; 

establishing a front point and a back point for said index point, the front point and the 
back point defining a stick vector; 

establishing a R vector from the index point to the selected reference point; 

determining a contour curvature value for the index point, the contour curvature value 
being a shortest distance between the index point and the stick vector; 

determining a stick angle, the stick angle being an angle between the stick and the 
horizontal axis; and 

determining a SR angle for the index point, said SR angle being the angle between the 
stick vector and the R vector. 

7. The method of claim 6, wherein a plurality of index points are chosen, and contour 
curvature values and SR angles are calculated, respectively, for each of said plurality of index 
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points. 

8. The method of claim 7, wherein the step of generating vector information for each of said 
at least one pattern contours, relative to the selected reference point, further comprises: 

for each index point of said plurality of index points, determining a GR angle between a 
gradient of each of said index points and the respective R vectors for said index points. 

9. The method of claim 6, wherein the step of creating at least one reference table containing 
said vector information comprises: 

grouping the SR angles based on a contour curvature value; 
grouping the stick angles based on the contour curvature value; and 
grouping the R vector information based on the contour curvature value. 

10. The method of claim 9, wherein the step of creating at least one reference table containing 
said vector information further comprises: 

grouping the GR angles based on the contour curvature value at the index point. 

1 1 . The method of claim 6, wherein the SR angle is rotation invariant. 

12. The method of claim 1, wherein the step of extracting at least one scene contour from a 
scene image comprises: 

locating at least one edge in the scene image; 

recording a starting point for the at least one edge of the scene image; 
crawling along the at least one edge of the scene image; 

extracting a plurality of pixels from the at least one edge, beginning with the starting 
point and continuing with pixels identified while crawling along the at least one edge of the 
scene image; 

filtering the plurality of extracted pixels; and 

creating a scene contour from the plurality of extracted pixels. 
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13. The method of claim 1, wherein the step of generating vector information for each of said 
at least one scene contours comprises: 

choosing at least one scene index point corresponding a point along said at least one 
scene contour; 

determining a scene stick angle, the scene stick angle being an angle between a scene 
stick and the horizontal axis; and 

determining a scene contour curvature and a scene SR angle for each of said at least one 
scene index points. 

14. The method of claim 13, wherein the step of generating vector information for each of 
said at least one scene contours further comprises: 

determining a scene GR angle for each of said at least one scene index points. 

15. The method of claim 1, wherein the step of determining whether the pattern has been 
located comprises: 

calculating at least one potential reference point based on the extracted scene contour 
vector information and recording the instance of each of said at least one potential reference 
points; 

calculating at least one potential angle of rotation based on the extracted scene contour 
vector information and recording the instance of each of said at least one potential angles of 
rotation; 

identifying a location of the pattern within the scene image using the recorded potential 
reference points; and 

determining an angle of rotation for the pattern within the scene image using the recorded 
potential angles of rotation. 

16. The method of claim 15, wherein the step of calculating at least one potential reference 
point comprises: 

calculating a potential reference point for each point in the reference table. 
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17. The method of claim 16, wherein the potential reference point is calculated from the SR 
angles and the vector information. 

18. The method of claim 15, wherein the step of calculating at least one potential reference 
point based on the extracted scene contour vector information and recording the instance of each 
of said at least one potential reference points comprises; 

adding the potential reference point to a reference point accumulator. 

19. The method of claim 15, wherein the step of calculating at least one potential angle of 
rotation based on the extracted scene contour vector information and recording the instance of 
each potential angle of rotation comprises: 

determining an angle difference between the scene stick angle and the stick angle in the 
reference table; and 

adding the potential angle of rotation to an angle accumulator. 

20. The method of claim 15, wherein the step of determining an angle of rotation for the 
pattern image comprises: 

clustering the potential angles of rotation; and 

identifying at least one potential angle of rotation where clustering has occurred beyond a 
predetermined threshold. 

21. A method for pattern recognition, comprising: 

extracting pattern vector information from at least one pattern image, each pattern image 
having a pattern reference point; 

creating a reference table containing the pattern vector information for each of the at least 
one pattern image; 

extracting scene contour information from a scene image; 

calculating a potential reference point based on the scene contour information and the 
reference table; 

matching the potential reference point with one of the at least one pattern reference 
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points; and 

identifying a pattern image corresponding to the matching pattern reference point. 



22. The method of claim 2 1 , further comprising: 
identifying an angle of rotation for the scene image. 

23. The method of claim 21, wherein the pattern vector information includes a rotation 
invariant angle. 

24. The method of claim 23 , wherein the rotation invariant angle is defined by: 
identifying at least one pattern index point on a contour of the pattern image; 
identifying a front point and a back point for the pattern index point, the front point and 

back point defining a stick vector; and 

identifying a R vector defined by the index point and the pattern reference point; 

wherein the rotation invariable angle is defined by a SR angle between the stick vector 
and the R vector. 

25. The method of claim 21, wherein the step of calculating a potential reference point based 
on the scene contour information and the reference table comprises: 

identifying at least one scene index point on a contour of the scene image; 
calculating the potential reference point for each of the scene index points based on the 
reference table; 

adding the potential reference point to a reference point accumulator; and 
determining a likely potential reference point. 

26. A system for pattern identification, comprising: 

a first image capture device that captures a pattern image, the pattern image including an 
image of a pattern; 

a second image capture device that captures a scene image to be searched for the pattern; 
a processor for processing the pattern image and the scene image, the processor 
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comprising: 

means for extracting at least one pattern contour from the pattern image; 
means for generating vector information for each of said at least one pattern 
contours, relative to a reference point; 

means for creating at least one reference table for storing vector information, each 
of said at least one reference tables corresponding to at least one pattern contour; 

means for extracting at least one scene contour from a scene image; 

means for generating vector information for each of said at least one scene 

contours; and 

means for locating the pattern image within the scene image using the at least one 
reference table and the vector information for the at least one scene contours. 

27. The system of claim 26, further comprising: 

a database for storing the at least one reference table. 

28. The system of claim 27, wherein the database stores at least one reference table for a 
plurality of pattern images. 

29. The system of claim 26, wherein the first image capture device and the second image 
capture device comprise a common image capture device. 
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SYSTEM AND METHOD FOR PATTERN IDENTIFICATION 

ABSTRACT OF THE DISCLOSURE 

A system and method for pattern identification are disclosed. According to one 
embodiment of the present invention, the method for locating a pattern includes the steps of (1) 
providing a pattern image corresponding to the pattern to be located; (2) extracting a pattern 
contour from the pattern image; (3) generating vector information for the pattern contours, 
relative to a reference point; (4) creating a reference table for storing the vector information, the 
reference tables corresponding to the pattern contour; (5) providing a scene image, which will be 
searched for the pattern; (6) extracting a scene contour from the scene image; (7) generating 
vector information for the scene contours; and (8) determining whether the pattern has been 
located within the scene image using the reference table and the vector information for the scene 
contour. According to another embodiment, a system includes a first image capture device that 
captures a pattern image which includes an image of a pattern; a second image capture device 
that captures a scene image to be searched for the pattern; a processor for processing the images, 
which includes means for extracting at least one pattern contour from the pattern image; means 
for generating vector information for each of said at least one pattern contours, relative to a 
reference point; means for creating at least one reference table for storing vector information, 
each of said at least one reference tables corresponding to at least one pattern contour; means for 
extracting at least one scene contour from a scene image; means for generating vector 
information for each of said at least one scene contours; and a means for locating the pattern 
image within the scene image using the at least one reference tables and the vector information 
for the at least one scene contours. 




FIG. 2 



: f i 



rdfer^ncd. 'table 



301 



i 1 ; 



3Qt 



■30S 



( 5TDP > 



ccrrtaucs 



*0% 




Q 3TO-? 



ikim sew* 



50 z. 



5b8 



Of coinfficft 



5/0 



•5H- 




HS. 5 




Fig. 6b 




Fig. 8 



51 

m 

a 
yi 
ry 

a 
O 
y] 
a 
a 




Fig. 9 




ooo 



i 1 i' 1 



Fig. 1 1 




Fig. 12 



V 



Attorney Docket No.: Imaging 1 

DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 

As the below named inventor, I hereby declare that; 

My residence, post office address and citizenship is as stated below next to my name; 

I believe that I am the original, first and sole inventor (if only one name is listed below) or an 
original, first and joint inventor (if plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention entitled: 

SYSTEM AND METHOD FOR PATTERN IDENTIFICATION 

the specification of which: El is attached hereto. 

□ was filed on: 

as Application No.: 

and was amended on (if applicable). 

I have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. I acknowledge the duty to disclose 
J information which is material to patentability as defined in 37 C.F.R. § 1.56. 

jgj Prior Foreign Appllcation(s) 

g I hereby claim foreign priority benefits under Title 35, United States Code, § 119(a)-(d) or 

§ 365(b) of any foreign application(s) for patent or inventor's certificate, or § 365(a) of any PCT 

;jj international application which designated at least one country other than the United States of 
America, listed below and have also identified below any foreign application(s) for patent or 

;^ inventor's certificate having a filing date before that of the application on which priority is claimed: 



7p Country 


Application 
Number 


Date of Filing 
(day, month, year) 


Date of Issue 
(day, month, year) 


Priority Claimed 


Si N/A 








Yes □ 


No □ 










Yes □ 


No □ 










Yes □ 


No □ 



Prior Provisional Application(s) 



I hereby claim the benefit under Title 35, United States Code § 1 19(e) of any United States 
provisional application(s) listed below: 



Application 
Number 


Date of Filing 
(day, month, year) 


N/A 













Prior United States Application(s) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s), or § 365(c) of any PCT international application designating the United States of 



America, listed below and, insofar as the subject matter of each of the claims of this application is 
not disclosed in the prior United States application in the manner provided by the first paragraph of 
Title 35, United States Code, § 112, I acknowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the filing date of 
the prior application and the national or PCT international filing date of this application: 



Application 
Number 


Date of Filing 
(day, month, year) 


Status - Patented, 
Pending, Abandoned 


N/A 













And I hereby appoint, both jointly and severally, as my attorneys with full power of 
substitution and revocation, to prosecute this application and to transact all business in the Patent 
and Trademark Office connected herewith the following attorneys, their registration numbers being 
. listed after their names: 



Rodger L Tate, Registration No. 27,399; Anthony W. Shaw, Registration No. 30,104; James 
^Remenick, Registration No. 36,902; Michael J. Songer, Reg. No. 39,841; ConoA. Carrano, 
-: Registration No. 39,623; Laurence H. Posorske, Registration No. 34,698; Floyd B. Chapman! 
; Registration No. 40,555; David J. Kulik, Registration No. 36,576; Robert A. King, Registration No.' 
42,738; and Trevor Q. Coddington, Registration No. 46,633. 



All correspondence and telephone communications should be addressed to: Intellectual 
'Property Department; Brobeck, Phleger & Harrison LLP; 1333 H Street, N.W.; Suite 800; 
; Washington, DC 20005, telephone number (202) 220-6000; facsimile number (202) 220-5200, 
I which is also the address, telephone and facsimile numbers of each of the above listed attorneys. 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine and imprisonment, or both, under 18 U.S.C. § 1001, and that such willful false 
statements may jeopardize the validity of the application or any patent issuing thereon. 



Signature 

Full Name of 
First Inventor: 



Citizenship: 

Residence: 

Post Office 
Address: 



Date 



TYMINSKI 

(Family Name) 

Poland 



Daren 

(First Given Name) 



(Second Given Name) 



32 Dorset Street, Boston, MA 02125 



32 Dorset Street, Boston, MA 02125 



BROBECK, PHLEGER & HARRISON, LLP 
1333 H Street, N.W. 
Suite 800 
Washington, D.C. 20005 
(202) 220-6000 (telephone); (202) 220-5200 (facsimile) 

Page 2 



Signature 



Date 



Simon 

(First Given Name) 



Full Name of 

Second Inventor: MELIKIAN 
(Family Name) 

Citizenship: United States of America 

Residence: 3105 Northwood Lane, Westlake, OH 44145 

Post Office 

Address: 3105 Northwood Lane, Westlake, OH 44145 



Haig 

(Second Given Name) 




BROBECK, PHLEGER & HARRISON, LLP 
1333 H Street, N.W. 
Suite 800 
Washington, D.C. 20005 
(202) 220-6000 (telephone); (202) 220-5200 (facsimile) 

Page 3 



